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INTRODUCTION 


This  talk  is  concerned  with  the  preparation  of  titles,  abstracts  and 
keywords  in  technical  reports  of  the  Department  of  Defense.  The  reason 
for  selecting  this  topic  s'.ems  from  the  conviction  that  the  quality  of 
these  three  aspects  of  technical  reporting  are  essential  to  the  effective 
transfer  of  documented  S&T  information- 

As  you  will  recall,  the  quality  of  titles,  abstracts,  and  keywords 
has  been  highlighted  and  brought  to  the  attention  of  the  whole  research 
and  engineering  community  by  the  so-called  Weinberg  Report.  This 
President's  Science  Advisory  Committee  report  stated  that  the  individual 
scientist  and  engineer  must  participate  in  the  information  transfer 
process,  and  not  leave  the  entire  process  to  the  professional  documenta - 
list.  In  particular  it  urged  the  authors  to: 

"a.  Title  papers  in  a  meaty  and  Informative  manner 
"b.  Index  their  contributions  with  keywords  taken  from  standard 
thesauri 

"c.  Write  informative  abstracts." 

I  am  sure  you  are  familiar  with  the  way  in  which  this  set  of  recommen¬ 
dations  has  been  implemented  in  the  Department  of  Defense,  and  therefore 
will  skip  the  chronology  of  various  DoD  actions.  The  tangible  product 
of  this  implementation  is  the  current  DD  Form  1473,  and  the  corollary 
instructions  in  the  Armed  Services  Procurement  Regulations. 

But,  to  tell  the  authors  \diat  must  be  done  and  providing  them  with 
a  form  on  which  to  do  it  is  itet  enough.  Authors  are  not  abstracters 
or  indexers.  They  cannot  be  expected  to  know  the  art  of  documentation 


as  well  as  they  know  theii  science.  If  we  expect  them  to  do  the  work 
of  documental is ts ,  we  are  obliged  to  advise  them  about  the  criteria 
and  techniques  of  the  documentation  profession. 

Unfortunately  neither  the  Weinberg  Report,  nor  the  Procurement 
Regulations,  ncr  nmst  of  the  service  regulations  and  guides  offer 
this  kind  of  advice.  Further,  many  of  the  organizational  editors 
employed  to  help  the  authors  with  their  writing,  know  little  about 
information  retrieval,  and  therefore  don't  offer  this  kind  of  advice. 

What  is  still  worse,  as  yet  there  is  no  universal  agreement  even 
among  the  documents lists  on  criteria  to  be  applied.  Depending  on 
one's  orientation  there  are  those  who  favor  brevity  and  propose 
telegraphic  style  even  at  the  expense  of  clarity.  Others  cake  an 
opposite  view.  Still  others  cannot  agree  on  the.  verb  forms,  points 
of  view,  length  or  inclusion  and  exclusion  of  certain  data.'  ' 

These  and  other  subjects  have  been  now  studied  by  an  American 
Standards  Association's  Working  Group  on  Abstracts  for  over  two 
years.  Hopefully  an  agreement  can  be  reached  soon. 

My  purpose  today  is  not  to  establish  universal  standards.  Rather, 
I  want  Co  point  out  some  of  Che  shortcomings  found  in  DoD  technical 
reports  and  to. suggest  a  few  guidelines  toward  better  titles,  better 
abstracts  and  more  useful  keywords  until  the  ASA  standards  become 
available.  1  hope  some  of  you  may  find  these  guidelines  useful. 

TITLES 

Shortcomings 

To  acquaint  you  better  with  the  shortcomings  in  titles  I  have  here 
a  few  horrible  examples  taken  from  actual  DoD  technical  reports.  The 
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first  one  reads  "Electrical  and  Electronic  Properties  of  Materials 
Information  Retrieval  Program."  Believe  it  or  not,  it  has  been  composed 
by  information  specialists.  Contrary  to  my  expectation,  it  does  not 
deal  with  the  electrical  and  electronic  properties  of  materials. 
Actually,  it  is  a  status  report  of  the  Information  Center  on  Electrical 
and  Electronic  Properttes  ot  Materials  located  at  rhr  Hughes  Aircraft 
Company . 

The  next  one  seems  to  be  more  suitable  for  a  detective  story;  its 
title  proclaims  in  bold  capital  letters  "ELF  INVESTIGATIONS."  To  the 
initiated"  it  means  that  the  docviment  deals  with  the  extremely  low 
frequencies,  but  to  the  computer  and,  for  that  matter,  to  a  $3500/year 
key  punch  operator,  it  means  nothing. 

Figure  1  shows  other  examples  of  "un-information."  Very  likely 
the  first  award  should  go  to  the  one  titled  "Input-Output  Experiment." 

It  deals  with  an  experiment  to  determine  the  feasibility  of  using 
auroral  phenomena  to  simulate  the  ionizing  effects  produced  by  high 
altitude  nuclear  detonations;  clearly  an  cspect  of  geophysics  and 
not  of  computer  technology. 

The  Problem 

The  construction  of  an  informative  title  is  not  easy.  Remember 
that  here  one  tries  to  abstract  from  a  500-or  5000-word  paper  the 
contents,  the  significance,  and  the  nature  of  the  work,  and  express  all 
this  in  five  or  six  words.  Which  of  these  500  words  to  select  -  this  is 
the  dilemma.  It  is  useless  to  criticize  authors  when  they  come  out  with 
unacceptable  titles.  The  thing  to  do  is  to  offer  them  adequate  sugges¬ 
tions  which  will  allow  them  to  make  a  selection  of  informative  terms. 
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Figure  I 


Since  titles  are  for  the  benefit  of  the  would-be  reader,  let's 
consider  what  might  go  through  the  reader's  mind  when  he  looks  at  a 
title  and  decides  whether  or  not  to  order  the  paper  from  his  library. 
I  suspect  that  the  first  question  he  might  ask  himself  is:  "Do  I 
recognize  any  words  here  that  represent  the  subjects  in  which  I  am 
interested?"  His  second  might  be:  "Does  the  author  cover  the  area 


with  appropriate  orientation,  i.e,,  is  it  viewed  from  the  point  of 
view  which  1  would  like  to  explore?"  Finally  he  might  hesitate  on  the 


nature  of  the  writing:  "Is  it  theoretical,  practical  work  of  immediate 
application,  original  work,  review  of  literature  on  the  subject,  a  new 
way  of  applying  old  knowledge,  etc.?" 

Wlten  the  reader  has  the  document  in  his  hand,  or  uses  such  a 
publication  as  the  Technical  Abstract  Bulletin  of  the  Defense  Documenta¬ 
tion  Center,  an  affirmative  answer  to  the  first  question  may  lead  him 
to  scan  the  abstract  where  his  second  and  third  question  will  be 
answered.  But  when  the  source  is  a  document  such  as  the  Inde?-  of 
OAR  Research  Results  which  lists  only  titles,  or  a  list  of  references 
In  another  paper,  he  must  either  order  the  document,  ask  other  people 
if  they  know  about  it,  or  forget  the  whole  sorry  mess  and  go  on  with 
his  regular  work. 

Suggested  Elements  of  an  Informative  Title 

If  you  accept  this  as  a  reasonable  assumption  of  the  reader's 
behavior,  you  might  construct  for  yourself  a  set  of  preliminary  criteria 
for  an  informative  title.  Accordingly^  a  good  informative  title  will 
contain  words  which  give  a  clue  to. 

a.  The  subject  of  the  paper  (what  area  is  studied) 

b.  The  purpose  of  the  study  (what  are  we  looking  for) 

c.  The  nature  of  the  study  (report  on  an  experiment,  state- 
of-the-art,  critique,  etc.) 

These  words  must  now  be  connected  into  a  meaningful  phrase.  The 
meaning  is  achieved  by  the  use  of  prepositions  and  conjunctions.'  ' 

By  way  of  Illustration  let  us  take  a  look  at  the  document  mentioned 
earlier  titled  "ELF  INVESTIGATION."  Prom  reading  the  Introduction  we 
find  that  the  author  studied  the  naturally  occurring  magnetic  signals 
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in  the  frequency  range  of  about  10  cycles  per  second.  The  same  introduction 


reveals  that  he  studied  it  in  order  to  determine  the  global  behavior  of  these 
signals.  Finally,  from  the  text  it  became  apparent  that  this  is  the  first 
time  that  anyone  has  tried  to  conduct  measurements  on  such  a  large  SfJalt. 
Using  our  set  of  criteria  we  could  reconstruct  the  title  to  read:  "World- 
Wide  Magnetic  Field  Measurements  of  Extremely  Low  Frequencies  in  the 
Atmosphere." 

There  a’'®  ways  the  title  could  be  constructed,  using  different 

words  and  a  different  way  of  connecting  them  into  a  meaningful  phrase.  But 
it  requires  that  the  author  consider  the  eventual  reader,  evaluate  the 
contents  of  the  report,  and  pay  attention  to  the  informational  content  of 
single  words. 

Other  Attributes  of  a  "Good"  Title 

As  you  know,  practically  all  titles  will  at  some  time  or  other  be 
mechanically  processed.  The  digital  computer,  designed  to  reduce  the 
drudgery  of  repetitive  operations,  is  still  rather  a  simple  beast  operating 
on  numbers  one  and  zero,  and  limited  to  a  precise  set  of  logic  designed 
by  its  programmer.  It  imposes  therefore  a  set  of  limitations  which  must 
be  observed.  In  case  of  titles  these  limitations  deal  with  the  length  of 
titles,  superscripts  and  subscripts  and  use  of  words  of  broad  and  general 
meaning . 

Length. If  possible  the  length  of  a  title  should  be  limited  to  about 
100  characters  (including  spaces  between  words).  Many  of  the  so-called 
Keyword  in  Context  Indexes  still  use  a  program  which  allows  only  60 
characters  to  be  printed;  words  beyond  this  limit  are  omitted  (Figure  2). 
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Figure  2 
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Those  of  you  who  are  interested  in  the  technicalities  of  this  limitation 
should  read  Luhn*s  paper  on  KWIC.^^^ 

*'Forbldden"Word8 .  The  premium  placed  on  space  in  the  computer's 
memory  dictatCo  that  words  of  general  significance  be  avoided.  Those  who 
design  retrieval  systems  know  that  one  is  seldom  interested  In  such 
words  as  "report,"  "explanation,"  "uses,"  "model,"  "aerospace,"  as 
recognition  or  retrieval  clues.  Hence  an  effort  is  made  to  place  them 
on  the  "forbidden"  list;  the  computer  automatically  excludes  them  from 
being  used  as  indexing  terms.  In  an  index  concerned  with  information 
handling,  It  is  entirely  possible  that  a  title  "Report  on  Some  Most 
Recent  Thoughts  Affecting  the  Exchange  of  Information  in  the  Field  of 
Technological  Innovation"  would  be  automatically  excluded. 

Symbols .  The  third  limitation  is  in  the  use  of  superscripts  and 
subscripts.  This  is  due  to  the  present  limitations  in  many  computer 
print-outs  which  will  write  CO2  as  C02;  as  (CH3)3NH  PLUS;  and 

log2  as  L0G2  PI.  Keypunch  personnel  cannot  be  expected  to  translate 
all  of  these  symbols  into  equivalent  word-descriptors. 

The  advances  in  computer  technology  and  information  processing 
techniques  will  in  time  solve  some  of  the  problems;  in  the  meantime 
we  should  be  careful  to  produce  titles  which  can  be  machined  with  the 
existing  tools  and  techniques.  This  is  one  way  to  assure  that  our 
writings  are  brought  to  the  attention  of  others. 

INFORMATIVE  ABSTRACTS 

The  Problem 

Abstracts  come  in  two  general  types;  the  indicative,  which  is 
not  much  more  than  a  healthy  extension  of  the  title,  and  the  informative  , 
which  gives  the  actual  substance  of  the  paper.  Historically  the 


Informative  abstract  was  developed  to  act  as  a  substitute  for  the  paper;  a 


natural  reaction  to  the  inability  of  certain  groups  to  keep  up  with  the 
literature  in  rapidly  expanding  fields.  The  writing  of  such  abstracts  became 
a  highly  skilled  business  -  not  likely  to  be  done  well  by  non-scientists. 

This  led  the  abstracting  services  to  employ  scientists  in  various  disciplines, 
usually  on  a  nonresident  basis.  Shortages  of  scientists  willing  to  do  this 
work  further  led  the  Journals  to  require  "author  abstracts." 

Unfortunately  many  authors  simply  do  not  know  the  difference  between 
an  informative  and  indicative  abstract;  even  fewer  of  them  know  the 
essential  elements  which  should  be  included  in  the  informative  abstract 
to  convey  the  important  contents  of  the  paper.  What  is  still  worse,  many 
editors  are  too  preoccupied  with  commas  and  margins  to  give  sufficient 
attention  to  this  part  of  the  report. 

The  examples  of  poor  abstracts  are  many  and  varied,  A  most  recent 
example  worth  exhibiting  is  one  prepared  by  the  people  who  should  know 
better.  It  can  be  seen  in  all  its  glory  in  Figure  3.  Of  course,  this  is 
an  extreme  case.  Most  abstracts  are  at  least  intended  to  convey  some 
information  about  the  document. 

THE  CRITERIA  FOR  AN  INFORMATIVE  ABSTRACT 

The  Contents 

If  the  abstract  is  to  give  faithful  representation  of  the  paper,  it 
ought  to  tell  us;; 

Why  the  work?  (the  purpose) 

How  accomplished?  (the  method) 

What  facta?  (the  results) 

What  meaning?  (the  conclusion) 
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Contains  various  papers  read  and  working  group  reports  developed  at  the 
AF  STINPO  Conference. 


Note  I  have  not  uentioned  the  **What."  This  should  be  evident  from 


the  title  which  accompanies  the  abstract;  in  fact  Che  title  is  normally 
considered  as  part  of  the  abstracting  entry.  The  "What**  will  also 
become  evident  from  the  words  in  the  abstract.  The  purpose,  method, 
results  and  conclusion  are  then  the  essential  elements  of  the  abstract. 


The  Abstract  in  Figure  4  meets  these  criteria. 


Tne  wen*#* 


;  We  «^erlaMiile(to  dMemtM'^  electnaftmerectlon  tn  decaying  alterglew 

‘  pleetnee  at  ten^mretnree  ee  in*  m  bucll  lliw*iiierrtya‘efe  present  when  the  parent  gaa  la  Un» 
msread  in  a  bath  of  U^ild  heltun  of  4,f^.  Ou<nStogjncluded  electronic  microwave  dlagnoatle 
teebni<|uee  couplod  with  radktmetric  procecbireeT^kp^menta  were  performed  for  neutral  denattlee 
tn  the  r»"f  1.3  *  10^^  to  1.3  *  iO^*  atoma/cc.  Concurrently,  we  Inferred  electron  tempereturee  from 

i  mlemw^we  Boiae  radlatiOH  from  the  afterglow  PlaiJBi. - - - - -  - - 

"An  "ettectiva"  colltaloa  croaa  aoction  computed  on  the  baala  of  binary  colltalon  theory  la  1,9 
ctr  at  the  low  and  at  the  above  density  range.  This  value  la  3)  timea  larger  than  the  croaa 
•aciioa  at  300^^. 

The  electron  temperature  relaxation  during  plaama  decay  U  some  two  ordera  of  magnttuda  longer . 
than  that  expected  U  the  dominant  mechanism  were  elastic  eolUetona  with  neutral  gaa  atoma. 

Electron  heating  tbroui^  auperelaatic  colUatona  with  a  helium  atnglet  metasutde  atom  appMr  to  | 
iho  the  ceuee  of  long  relaxation  timea.  A  croaa  aectlon  of  6  x  10*3  cm*  at  4.3'^K  la  deduced  lor  the 
^  plUa^gride^mitation of  thaao  metaaable  atoma  by  atoma  in  the  ground  state. 

I  i^lm^^^^riit'prgldw'^iiciang'e^riiheMa  Ihdit^tulhattelectton'fecdmliinatlon  kwa  In 
'  low  teiKl^ipihfn  helium  pUemaa  may  be  controlled  by  tbe  rate  of  pxpduction  of  helium  molecular 


iTec 


lbs  EgSMcra 


Figure  4 


Of  course  not  all  the  abstracts  can  be  broken  down  this  way,  or  In 
this  order.  The  order  may  differ  because  it  may  be  easier  for  the 
author  to  start  with  the  conclusion  and  end  with  the  method.  The  paper 
may  not  have  a  conclusion  because  it  represents  only  a  compilation  of 
data.  The  method  may  not  be  appropriate  because  the  paper  is  only  a 
review  of  work  done  by  others.  These  variations  must  be  accepted. 
Nevertheless  the  attempt  to  consider  these  elements  should  result  in 
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better  and  more  informative  abstracts.  As  a  minimum  it  will  get  you  to 
think  about  the  Informational  concent  and, where  necessary,  it  will  lead  you  to 
substitute  other  Important  aspects  such  as  scope  of  the  investigation, 
validity  of  the  experiment  and  similar  attributes  of  the  work.  It  may 
also  lead  you  to  reconsider  the  contents  of  your  paper.  You  may  even 
rewrite  it. 

Phrases  and  Symbols.  The  second  element  concerns  the  use  of  words, 
phrases  and  symbols  to  reflect  the  informational  content.  As  you  know 
the  brevity  of  the  abstract  is  its  essential  characteristic.  So  is  the 
clarity,  if  the  abstract  is  to  convey  meaningful  information.  These 
two  are  often  mutually  at  odds;  striking  a  satisfactory  balance  is  an 
art  which  must  be  acquired  by  practice.  One  way  to  assure  clarity  is 
to  question  every  technical  word.  Here  the  use  of  the  dictionary 
will  help;  not  as  an  authority  to  determine  the  meaning  of  the  word 
used  in  your  specialty,  but  to  find  out  if  the  word's  everyday  meaning 
may  mislead  the  reader. 

Length.  On  the  side  of  brevity  the  abstract  is  best  when  it  is 
limited  to  200-250  words.  This  can  be  done  in  most  cases  by  avoiding 
idle  words,  which  do  not  add  to  the  informational  content.  Figure  5 
shows  how  an  author-prepared  abstract  was  reduced  by  simply  crossing 
out  the  words  and  phrases  without  noticeably  reducing  the  informational 
content  of  the  abstract.  Figure  6  shows  what  can  be  done  with  a  simple 
reorganization  of  the  text.  Figure  7  shows  an  abstract  rewritten  to 
conform  with  our  formal  criteria  for  an  Informative  abstract. 
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Figure  5 


AMA»»0  AAanaal 

TMaaijr-lAr***'  tl—llaaAaat  MKiaiAMralA  #f  IAa  AaAltaAial  BAfAailc 
ricIA  la  S-l!*  rpM  rm»ip  wtra  aail*  aaaa  Klafaiaa,  A.I.  aaO  ■raaOAAAart. 
(i«raM*i.  tW  atiaadiAA  am  tAal  II  lAa  naaa  Iaam  iMtM  at  AalA 
laaaiiau  aami  lfa»  IAa  tiaa  lAsrA*  «A»|i  «mU  appiu  allAla  aaa  laaiA 
•■cam  ••  AaiA  rAcarOt. 

TA«  raaatia  aAa*  iMi  a»i  a#  iMAif-iArA*  rtaArOlata  lA  caaiaIa  maa  Iaaaa 
■AUa  AAfla  aiiAtA  0.1  aaaaaO  aI  aacA  tlAtr  At  AaiA  aiaIIaaa.  SlAlltlict 
AAAlAAli  Af  At<A  ValAAl#  AAiAfO  IaOIcaiaa  iAai  IAa  AAAAar  al  aIamIIAAAAa 
aacaIaaO  aI^Ia  Ia  iaa  Iataa  la  Aa  puplf  acclOAAia*  calAClOatAA. 

TAa  AiMtiMaaAA  aAtaraMi  al  aairtMlf  Iaa  IraoaaaAl  •>•••  iralaA  ai 
iaaia  lacAilaai  lAaai  iIdaIIUmi  AAcraUllMi  mIIA  lAa  iaOaa  11  lAiafrAia 
IIMa-ilpAa  flacA  tmipf  trtm  lAt  alilAlA  OIaA  af  lAa  iaa. 

Aa  a  alalMAi  It  alll  ft  IAA  talAar  la  eaaAlOar  lAaca  oaIaIa>  aaO  af 
■acAiAAri  •at^tlll■l•  alAaf  la^riAal  AAOaciA  aacA  aa  ••■*■  af  lAa 
lAAAAtl(A*l**-  AAllAllf  Af  IA#  aaAarlaaal  AaO  lAa  IIAa. 

Figure  6 
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Figure  7 
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INDEXING  THE  PAPER 


The  Problem 

The  shortage  of  indexers  is  forcing  still  another  task  on  the 
authors.  Here  the  author  is  asked  to  indicate  by  a  set  of  single  words 
or  short  phrases  the  clues  by  means  of  which  one  may  search  for  a 
document  in  a  collection  of  many  papers  on  varied  topics.  This  is 
an  area  of  heated  controversy  among  the  documental is ts  and  retrieval 
specialists.  It  is  not  my  purpose  to  join  this  controversy.  Rather, 

I  would  like  to  point  out  that  the  Engineers'  Joint  Council  requires 
author  indexes  for  papers  published  in  their  journals,  and  recently  the 
Department  of  Defense  made  this  requirement  a  companion  to  the  author- 
produced  abstracts.  Here  is  what  the  Department  has  to  say  about 
indexing  terms : 

"KEYWORDS:  Keywords  are  technically  meaningful  terms  or  short 
phrases  that  characterize  a  report  and  may  be  used  as  index 
entries  for  cataloging  the  report.  Keywords  must  be  selected 
so  that  no  security  classification  is  required.  Identifiers, 
such  as  equipment  model  designation,  trade  names,  military 
project  code  name,  geographic  location,  may  be  used  as  keywords 
but  will  be  followed  by  an  indication  of  the  technical  context." 
Selection  Criteria 

If  author  indexes  are  to  be  more  than  a  random  collection  of 
general  terms  (of  little  value  in  a  retrieval  systei.i)  then  a 
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generalized  sec  of  criteria,  like  Chose  for  titles  and  abstracts,  is 
necessary. 

Accordingly,  I  would  like  to  suggest  the  following  set  of  "rules," 

1.  Use  terms  which  have  a  precise  meaning.  Either  a  manual  or 
machine  system  can  easily  translate  the  specifics  to  the  general. 

The  reverse  is  not  possible. 

2.  If  possible,  also  use  the  terms  listed  in  the  DDC  Thesaurus 
of  Descriptors.  This  is  the  vocabulary  of  DDC;  this  is  the 
primary  place  where  your  index  terms  will  be  used.  If  you  use  a  new 
term  (as  yet  not  in  current  use)  explain  its  meaning. 

3.  Plan  to  use  at  least  one  term  for  each  of  the  following 
aspects  of  the  research  (or  study): 

a.  Specific  materials/data/theories/theses  studied 

b.  Specific  properties  determined  experimentally  (or  theoretically) 

c.  Specific  methods  or  processes  investigated 

d.  Equipment  used 

e.  Specific  applications  for  materials /methods/processes/ 
equipment,  wherever  they  show  promise  beyond  the  particular  experiment 

4.  Also  add  the  generic  expression  to  the  specific  terms,  i.e., 
"supersonic  aircraft"  as  well  as  "B-70." 

These  are  a  few  simple  guides.  They  will  not  make  authors  to  be 
expert  indexers;  nor  is  this  their  purpose.  But  they  will  make  the 
supplied  index  terms  mean  more. 

LINKS,  ROLES  AND  WEIGHTS 

Now  a  word  about  the  links,  roles  and  weights.  Although  they 
are  optional  parts  of  the  DoD  instruc-ion,  they  deserve  our  consideration. 
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Why  Links.  Roles  and  Weights? 


Briefly,  these  three  concepts  were  developed  to  cope  with  the  problems 
of  false  retrieval.  The  false  retrieval  occurs  when  the  Index  terms  used 
as  clues  to  retrieval  of  documents  recover  the  documents  v?hich  are  not 
relevant  to  the  problem  of  the  user.  This,  in  the  language  of  information 
specialists,  is  known  as  "false  drops"  or  simple  "noise." 

The  noise  occurs  because  the  index  terms  have  been  removed  from  the 
context.  Standing  alone  they  do  not  show  how  they  were  used  in  the  text. 
You  don’t  know  their  relationship  to  other  index  terms  which  describe 
the  document.  You  have  no  idea  whether  the  index  term  represents  a  serious 
and  detailed  treatment,  or  whether  It  was  used  only  in  passing  in 
connection  with  some  other  subject. 

Consider  the  following  index  terms  \diich  could  be  assigned  to  my 
lecture : 

Writing 

Abstracting 

Meaning 

Technical  Reports 

If  you  were  a  semanticist,  concerned  with  "meaning  of  words"  and 
asked  the  retrieval  system  to  get  you  documents  which  deal  with  "meaning," 
you  would  recover  my  paper.  For  you,  my  paper  would  be  simply  a  "false 
drop,"  Or  if  you  wanted  a  paper  on  the  outlines  for  writing  technical 
reports  and  asked  for  "writing"  and  "technical  reports"  the  recovery 
of  my  paper  would  similarly  be  discouraging. 

The  Basic  Concepts 

Briefly,  links  are  symbolic  representations  attached  to  the  index 
terms  to  show  that  certain  words  appear  together  in  a  sentence  or 
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paragraph;  i.e.,  they  are  sonehttw  linked  with  each  other.  Thus  the  1964 
OAR  Annual  Report  could  have  the  following  terms:  research,  budget, 
professional  personnel,  scientists,  rockets,  nuclear  physics,  etc.  The 
document  (let's  number  it  1000)  would  be  indexed; 


Research  lOOOA 
Budget  lOOOA 

Professional  personnel  iOOOB 
Scientists  IOOOB 
Rockets  lOOOC 
Nuclear  physics  lOOOD,  etc. 


The  letter  "A"  would  show  that  budget  and  research  are  connected  in 
the  document.  Similarly,  the  letter  "B"  would  link  the  terms  "professional 
personnel"  and  "scientists."  You  would  also  know  that  nuclear  physics  is 
not  linked  with  the  budget. 

Roles  are  the  symbols  which  act  as  a  sort  of  grammar  -  they  show  the 
function  of  the  word  in  a  document.  It  may  be  that  the  word  represents 
"something  which  is  acted  upon"  or  "an  agent  which  acts  upon  something." 
For  example,  a  paper  which  deals  with  the  "effects  of  cosmic  particles  on 
the  titanium  skin  of  a  spacecraft"  would  have: 


Cosmic  particles  200A2 
Titanium  200B1 
Spacecraft  200A1 
Skin  200B1 
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The  numeral  "1”  after  the  letter  "A"  signifies  the  object  which  is 
acted  upon  and  the  numeral  "2"  signifies  the  agent  which  acts.  These  are 
preassigned  meanings  as  determined  by  the  operators  of  the  retrieval  system. 

Weights  would  tell  you  the  emphasis  given  to  the  word  in  the  text. 

In  the  same  example  you  might  indicate: 


Cosmic  particles  2000A-2-2 
Titanium  2000B-1-1 
Spacecraft  2000A-1-3 
Skin  2000-B-1-3 


In  a  system  where  1  means  "extensive  treatment,"  2  means  "slight 
treatment,"  and  3  "mentioned  in  passing"  the  term  "Titanium"  would  be  the 
most  important  subject  in  the  report. 

The  Difficulties 

From  the  above  explanation  you  might  conclude  that  links,  roles  and 
weights  are  simple  concepts,  which  should  not  present  any  serious  problem 
in  their  application.  The  real  retrieval  systems,  however,  are  complex. 
They  have  many  thousands  of  documents;  even  more  index  terms.  They  deal 
with  more  than  one  topic,  from  many  points  of  view.  This  is  where  the 
simple  concept  of  links,  roles,  and  weights  runs  into  difficulties. 

Time  will  not  permit  me  to  deal  adequately  with  these  difficulties, 
and  1  must  refer  you  to  the  literature  on  this  subject  (References  6, 

7,  8  and  9).  Briefly  these  general  observations  are  applicable  to  links 
and  roles. 

a.  The  use  of  links  and  roles  breaks  down  unless  there  is  high 
consistency  in  their  assignment.  Usually,  only  the  trained  indexers  are 
capable  of  such  consistency. 
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b.  The  roles  used  in  engineering  sciences  may  be  totally  inadequate 
in  psychological  or  mathematical  sciences.  Separate  coding  systems  are 
often  required  for  various  disciplines,  and  for  different  collecflonsof 
documents . 

c.  The  links  can  do  a  decent  job  to  show  how  certain  words  are 
separated  in  a  document  which  deals  with  several  subjects  (such  as 
annual  or  quarterly  report).  They  are  inadequate  for  showing  relation¬ 
ships.* 


SUMMARY 

1  will  now  summarize  what  we  have  been  talking  about.  I  will  do 
this  in  the  form  of  an  "Author's  Check  List"  which  follows  (Figure  8). 
It  itiould  constitute  a  quick  reference  to  what  we  have  been  talking 
about.  It  can  also  be  used  as  a  check  list  for  writing  or  reviewing 
technical  reports. 

Titles,  abstracts  and  index  terms  are  our  present  "handles"  of 
recognition  and  retrieval.  The  more  frequent  use  of  machine  produced 
indexes,  the  demand  for  better  information  services,  the  increasing 
cost  of  processing  large  volumes  of  documents  and  a  greater  reliance 
of  users  on  "capsulated  information,"  demand  that  we  increasingly 
concentrate  on  these  handles  and  try  to  make  them  more  useful.  In 
this  way,  I  believe,  we  will  be  getting  at  the  root  of  many  problems 
which  plague  both  the  users  and  Che  operators  of  document  retrieval 
systems . 


*A  paper  by  Taube  explains  the  inherent  theoretical  inadequacy  of  links 
as  a  method  of  showing  the  relationship  between  words. 
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□  □D 


AUTHOR'S  CHECK  LIST 


Design 

r  1  The  purpose  of  the  work  is 
clearly  stated 

r  1  The  method  of  Investigation 
is  explained  or  referenced 

1  1  New  findings  are  easily  found 

in  the  text 

f  1  Conclusion  evident  or 
substantiated 

Title 

1  1  Definitive 

f  1  Subject  encompassing 

1  1  Superfluous  phrases 

eliminated 

[  ~  ]  Specific  terms  used 

1  1  Superscripts  and  sub- 

cripts  avoided 

Abstract 

Index  Terms 

1  1  Acts  as  a  substitute  for  the 

[  1  Words  of  special  signi- 

full  paper 

ficance  from  the  title 

or  abstract 

r  1  Gives  significant  results 

1  1  New  words  from  the  ceyt  for  • 

(including  most  important 

numerical  values) 

1  1  Material/equipment /rystem 

1  1  States  purpose  of  work 

1  1  Processes /techniques / 

1  1  Explains  method  used 

operations 

I  1  Interprets  the  meaning  of 

1  1  Properties/characteriS" 

findings  (conclusion) 

tics/attributes 

i  1  Generics 

1  1  Words  which  show  relation- 

ship  of  this  work  to  ocher 

disciplines  or  application;. 

Figure  8 


20 


REFERENCES 


1.  The  White  House,  Science.  Government  and  Infortnation.  A  Report  of  the 
President's  Science  Advisory  Coranittee,  Government  Printing  Office, 

Jan  10,  1963,  p  2, 

2.  Borko,  Harold  and  Seyraor  Chatman,  "Criteria  for  Acceptable  Standards; 

A  Survey  of  Abstracter's  Instructions,"  American  Documentation.  Vol  14 
No.  2  (Apr  63),  pp  149-160. 

.7.  Hoshovsky,  A.  G.  et  al,  Author's  Guide  for  Technical  Reporting.  OAR  64-8, 
Gftice  of  Aerospace  Research,  Washington,  D.  C.,  July  1964.  (Available 
from  OAR  (RRY),  Washington,  D.  C.,  as  well  as  from  DDC,  AD  605  443). 

4.  Luhn ,  Hans -Peter,  "Key-Word-ln -Context  (KWIC)  Index  for  Technical 
Literature,"  American  Documentation.  Vol  11, No.  4  ,';0ct  60,  pp  288-295. 

5.  Wooster,  Harold,  The  Preparation  of  Unsolicited  Proposals.  AFOSR  65-0392, 
Air  Force  Office  of  Scientific  Research,  Washington,  D.  C.,  1  Mar  65,  p  11. 

6  Tauoe,  Mortimer,  "Notes  on  the  Use  of  Links  and  Roles  in  Coordinate 

Indexing,"  American  Documentation.  Vol  12,  No.  2,  April  61,,  pp  98-100. 

7,  Sinnetr,  Jefferson  D.,  An  Evaluation  of  Links  and  Roles  Used  in 
Information  Retrieval.  ML  TDR  64-152,  Air  Force  Materials  Laboratory, 

Wright -Patterson  Air  Force  Base,  Ohio,  July  1964  (available  from  DDC). 

8,  Montague,  Barbara  A,,  "Testing,  Comparison,  and  Evaluation  of  Recall, 
Relevance,  and  Cost  of  Coordinate  Indexing  with  Links  and  Roles," 
Proceedings  of  the  American  Documentation  Institute.  Vol  1,  Oct  5-8, 

•964,  pp  357-367. 

9,  Costello,  J.  C.  Jr.,  "Storage  and  Retrieval  of  Chemical  Research  and 
Patent  Information  by  Links  and  Roles  in  DuPont,"  American  Documenta¬ 
tion.  Vol  12,  No.  2  (April  61),  pp  111-120, 


UNCUSS  I  FlhlJ _ 

Security  Ciossificittion 


DOCUMENT  CONTROL  DATA  •  R&D 

6f4tiilfl04ill4n  of  boity  ot  mud  snuiufMrffMi 

ovmrmtt  fpott  im  elmmmUtmd) 

1.  ORiniNATINC  ACTIWITT  (Corpotmto  mithot) 

Office  of  Aerospace  Research 

2«  HCfONT  »ecuni  TV  £  LAtXPIC  A  TION 

Unclassified 

Office  of  Scientific  and  Technical  Information 

2b  OROUP 

1 1.  neeoRT  rtTLK 

Suggested  Criteria  for  Titles,  Abstracts,  and  Index-Terms  in  DOD  Technical  Reports 

4  oetCRIRTIVf  NOTES  (Typm  al  npaH  and  Inaluaiaa  daUa) 

Management,  Application,  Final 

t.  AUTHORISE  (L»at  nsma.  Uni  imm,  UtlUml) 

Hoshovsky,  Alexander  G. 

s.  RERORT  DATE 

October  1965 

7a.  TOTAU  HO  OI>  RABCa 

21 

7b.  NO.  or  RCFa 

9 

•  a.  CONTRACT  on  oramt  ho.  N/A 

Sa.  ORIOINATOR'a  RCnORT  NlMABEn^SJ 

6.  nnOJKCT  NO.  N/A 

c. 

ni— m%mY  hm  I 

4. 

OAR  65-9 

10.  AVAI|.A*tklTV/I.IMITATION  NOTICES 

Distribution  of  this  document  is  unlimited. 

II  iUPPLEMENTARY  NOTES 

12.  SPONSORING  MILITARY  ACTIVITY 

Office  of  Aerospace  Resea*-ch  (RRYD) 
Washington,  DC  20333 

ts  ABSTRACT 


The  DOD  requires  that  its  authors  complete  DD  Form  1473  (a  bibliographic  control 
form)  on  all  DOD  technical  reports.  This  requirement  should  be,  but  is  not  now, 
accompanied  by  a  set  of  criteria  for  the  preparation  of  titles,  abstracts  and 
keywords . 

The  titles  should  be  definitive,  subject  encompassing,  and  composed  from  specific 
terms.  Superfluous  phrases,  superscripts  and  subscripts  should  be  avoided.  The 
abstracts  should  contain  statements  of  purpose  of  the  study,  methodology  used, 
give  significant  results,  and  interpret  the  meaning  of  the  study;  they  should  act 
as  a  substitute  for  the  whole  repo’’t.  Index-terms  should  be  those  which  describe 
the  materials,  equipment  or  systems  used  in  the  study;  processes,  techniques,  or 
operations  inherent  in  the  study.  They  should  contain  both  generic  and  specific 
expressions,  as  well  as  words  which  show  relationship  of  the  reported  work  to 
other  disciplines. 

The  use  of  links  and  roles  (an  optional  DOD  indexing  requirement)  is  questioned 
because  it  requires  a  consistency  in  indexing,  as  well  as  different  role- 
definitions  in  different  document  collection. 

The  adoption  of  the  proposed  criteria  should  lead  to  a  more  meaningful  author 
participation  in  the  DOD  documentation  process. 

DD  1473  UNCLASSIFIED 


^ _ !  . 


Titling 

Abstracting 

Indexing 

Reporting 

Research  Program  Administration 

Documentation 

Technical  Reports 

Authors 

Automation 

Information  Technology 
Vocabulary 

Information  Retrieval 
Language 


INSTRUCTIONS 


1.  ORIQINATINQ  ACTIVITY:  Biu*r  th*  nam*  aiid  addr*** 
of  the  coatreetot,  tubcontrector.  grantee,  Department  of  De¬ 
fease  activity  or  other  organiaatlon  fcoiporafe  atitfior)  iaatting 
the  report. 

2a.  REPORT  8BCURTY  CLASSIFICATION:  Enter  the  ovei^ 
all  security  claasiflcatloii  of  the  report.  Indicate  whether 
“Restricted  Dste'*  is  Included.  M^lng  is  to  be  In  eccord- 
ance  with  appropriate  security  regulations. 

2b.  GROUP:  Automstic  downgrading  ia  apacified  In  DoD  Di¬ 
rective  5200. 10  and  Armed  Forces  Industrial  Manual.  Enter 
the  group  number.  Also,  when  eppllcablc,  show  that  optional 
marltings  have  been  used  for  Group  3  and  Group  4  as  author¬ 
ised. 

3.  REPORT  TITLE:  Enter  the  complete  report  title  in  all 
capital  lattcra.  Titles  la  all  caaea  ahoutd  be  unclassified. 

If  a  meaningful  title  cannot  be  selected  without  claasifica- 
tion,  show  tlUe  clesaificetlon  In  all  capitals  in  parenthesis 
immediately  following  the  title. 

4.  DESCRIPTIVE  NOTES  U  m>proprlate.  enter  the  type  of 
report,  e.g. ,  intarim,  prograae,  summery,  annual,  or  final. 

Give  the  Inclusive  datee  when  a  specific  reporting  period  is 
covered. 

5.  AUTHORfS):  Enter  the  neeie(s)  of  authoKe)  as  shown  on 
or  in  Che  report.  Eckoi  test  name,  first  name,  oiiddle  initial. 

If  military,  show  rank  and  branch  of  service.  The  name  of 
the  principal  aiithor  ia  an  absolute  minimum  raqulremant 

6.  REPORT  DATE:  Enter  the  date  of  the  report  os  day, 
montK  year,  or  month,  year.  If  more  than  one  data  appears 
on  the  report,  uoe  dote  of  publication. 

7a.  TOT.  .L  NUMBER  OF  PAGES:  The  total  page  count 
should  follow  normal  peginetion  procedures,  be.,  enter  the 
number  of  pages  containing  information. 

7b.  NUMBER  OF  REFERENCED  Enter  the  total  number  of 
references  cited  in  the  report.  ‘ 

Se.  ‘.ONTRACT  OR  GRANT  NUMBER;  if  appropriate,  enter 
the  sfpllcable  numbet  of  the  contract  or  grant  under  which 
the  report  wet  written. 

8b,  8c,  M  fed.  PROJECT  NUMBER:  Enter  the  appropriate 
military  department  identification,  such  aa  project  number, 
subproject  number,  system  numbers,  task  number,  etc. 

9e.  ORIGINATOR’S  REPORT  NUMBER(S);  Enter  the  offi¬ 
cial  report  number  by  which  the  document  will  be  identified 
end  controlled  by  the  originating  activity.  This  number  must 
be  unique  to  this  report. 

9b.  OTHER  REPORT  NUJMBFR(S):  If  the  report  has  been 
assigned  any  other  report  numbete  ('either  by  the  originator 
or  by  the  tponsor),  also  enter  this  number! s). 

10.  AVAILABILITY./LIMITATION  NOTICES:  Enter  any  lim¬ 
itations  on  fwiher  dissemination  of  the  report,  other  than  those 


Imposed  by  security  claeaiflcation,  using  staadaid  statamenta 
such  aa: 

(1)  “^allflad  requaatera  may  obtain  c'"  *s  of  thla 
report  from  DDC** 

(2)  “Foreign  announcement  and  dissemination  of  thla 
report  by  DDC  is  not  authorized. 

(3)  “U.  S.  Government  agencies  may  obtain  copies  of 
this  report  directly  ftom  DDC.  Other  qualified  DDC 
users  shall  request  through 


“U.  S.  military  agenciea  may  obtain  coplea  of  this 
report  directly  from  DDC.  Other  qualified  useta 
shall  request  through 


(5)  “All  distribution  of  this  report  Is  controlled  Qual¬ 
ified  DDC  users  shell  request  through 


If  the  report  has  been  furnished  to  the  Office  of  Technical 
SsTvicas.  DapartmanI  of  Commerce,  for  sate  to  the  public,  indi¬ 
cate  this  fact  and  enter  the  price.  If  known 

IL  SUPPLEMENTARY  NOTES;  Uae  for  additional  cxplane- 
tory  notes. 

IL  SPONSORING  MILITARY  ACTIVITY:  Enter  the  name  of 
the  dapaitmentel  project  office  or  latwratory  sponsoring  (pay 
iqg  tor)  the  taseerch  and  development.  Include  address. 

13.  ABSTRACT;  Enter  an  abstract  givlii-'  a  brief  and  factual 
summary  of  the  document  indicative  of  the  report,  even  though 
it  may  also  appear  alaewhere  in  the  body  of  the  technical  re¬ 
port.  If  additional  apace  Is  required,  e  continuation  eheet  shall 
be  attached. 

It  is  highly  deei.-able  that  the  abatract  of  classified  reports 
be  unclassified.  Each  |>aragraph  of  the  abstract  shall  end  with 
an  indicstion  of  the  militpry  eecurity  classification  of  the  in¬ 
formation  in  the  paragraph,  represented  as  (TS),  (SJ.  (C).  or  (V) 

There  ie  no  limitation  on  the  length  of  the  abstract.  How¬ 
ever,  the  suggested  length  is  from  ISO  to  225  words. 

14  KEY  WORDS:  Key  words  are  technically  meaningful  terma 
or  short  phrease  that  characterize  a  report  and  may  be  used  ae 
index  entries  for  cetsloging  the  report.  Key  words  must  be 
selected  so  that  no  security  claeslfication  is  required^  Identi¬ 
fiers,  such  as  equipment  model  designation,  trade  name,  military 
project  code  name,  geographic  location,  may  be  used  as  key 
words  but  will  be  followed  by  an  indication  of  technical  con¬ 
text.  Tho  assignmerit  of  links,  rules,  and  weights  is  optional. 


UNCLASSIFIED 


Security  Classification 


